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Abstract 

This  paper  presents  a  knowledge-based  scheduling  approach  based  on 
the  problem-solving  techniques  developed  in  artificial  intelligence. 
It  models  the  scheduling  process  by  state-space  transitions;  the  job 
routing  is  obtained  through  selecting  a  sequence  of  scheduling  opera- 
tors guided  by  heuristics.   Keeping  track  of  the  manufacturing  system 
by  a  symbolic  world  model,  this  approach  is  adaptive  to  such  environ- 
mental changes  as  new  job  arrivals  and  machine  breakdowns,  suitable  for 
making  real-time  scheduling  decisions.   A  scheduling  procedure  based 
on  the  A*  algorithm  is  described,  in  which  various  types  of  scheduling 
heuristics  can  be  taken  into  account.   The  paper  concludes  with  a  com- 
putation study  reporting  the  performance  resulting  from  these  heuristics 


I.   Introduction 

The  recent  advant  of  manufacturing  and  computer  technologies  has 
accelerated  the  realization  of  computer  integrated  manufacturing  where 
manufacturing  processes  are  fully  automated  with  computer-assisted 
decision-making  capability.   Flexible  manufacturing  systems  (FMSs), 
the  type  of  manufacturing  systems  that  can  produce  a  variety  of  items 
efficiently,  have  become  increasingly  important  in  the  effort  to  im- 
prove the  productivity  of  batch  manufacturing.   An  FMS  consists  of  a 
number  of  computer-controlled  machines  or  workstations,  an  automated 
material  handling  system  which  transports  workpieces  between  any  pair 
of  machines,  and  a  number  of  supervisory  computers  networked  together 
for  on-line  control.   By  integrating  the  versatile  numerical  control 
(NC)  machines  with  the  real-time  decision-making  capability  of  the 
supervisory  computers ,  an  FMS  is  able  to  reduce  the  flow-time  and  the 
set-up  time  significantly  and,  thus,  achieve  much  needed  efficiency  in 
manufacturing  a  variety  of  items  simultaneously. 

The  production  environment  in  an  FMS  is  a  highly  dynamic  one.   The 
machines  are  versatile  and  capable  of  performing  a  variety  of  opera- 
tions with  different  set-ups.   The  workpieces  can  be  transported  among 
machines  by  mobile  robots,  automated  guided  vehicles,  or  conveyors. 
Due  to  the  flexibility  of  the  system,  a  given  operation  usually  can  be 
performed  by  a  number  of  machines;  the  decision  on  assigning  a  job  to  a 
machine  depends  to  a  great  extent  on  the  situation  at  the  participation 
moment,  that  is,  the  decision  is  state-dependent.   In  addition,  some- 
times there  may  be  needs  for  cancelling  or  reassigning  machines  or  other 
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resources  because  of  unexpected  breakdowns.  Thus,  the  scheduling  deci- 
sion is  a  complex  one  which  needs  to  be  adaptive  to  environment  changes 
(Cutkosky  et  al .  (1983),  Ranky  (1983),  Merchang  (1983)). 

This  paper  takes  a  knowledge-based  approach  to  the  FMS  scheduling 
problem  drastically  different  with  the  conventional  scheduling  methods. 
It  models  the  scheduling  process  by  state-space  transitions;  the  job 
routing  is  obtained  through  selecting  a  sequence  of  scheduling  opera- 
tors guided  by  heuristics.   Keeping  track  of  the  manufacturing  environ- 
ment by  a  symbolic  world  model  in  the  knowledge-based  scheduler,  this 
approach  is  adaptive  to  such  environmental  changes  as  new  job  arrivals 
and  machine  breakdowns,  thus  suitable  for  dynamic  scheduling/rescheduling 

The  traditional  scheduling  approaches  usually  employ  one  of  the  three 
classes  of  techniques:   network  analysis,  combinational  methods,  and 
dispatching  heuristic  procedures.   However,  network  analysis  is  usually 
based  on  a  predetermined  network  and,  thus,  is  inadequate  for  dynamic 
scheduling  where  the  precedence  network  is  constantly  changing.   Com- 
binatorial method,  also  restricted  to  static  scheduling,  suffers  from 
the  complexity  problem  (i.e.,  combinatorial  explosion)  which  is  dif- 
ficult to  overcome  for  large  problems.   The  heuristic  scheduling  proce- 
dures use  relatively  simple  knowledge  representation  and  are  restricted 
to  limited  intelligence — they  use  rigid  heuristic  which  cannot  adapt  to 
environmental  changes  (Grant  (1986),  Brund  et  al .  (1986),  and  Kusiak 
(1986b)).   In  contrast,  the  approach  presented  in  this  paper  can  dyna- 
mically generate  schedules  represented  by  partially  ordered  networks; 
it  can  incorporate  heuristic  knowledge  to  expedite  the  scheduling 
process;  lastly,  it  is  equipped  with  a  structured  representation  scheme 
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based  on  the  same  inference  organization  used  as  an  information  pro- 
cessing model  for  human  problem  solving  (Hayes-Roth  and  Waterman 
(1978),  Newell  and  Simon  (1972)). 

The  remainder  of  this  paper  is  organized  as  follows.   Section  II 
gives  an  overview  of  the  knowledge-based  scheduler  and  the  information 
organization  of  the  knowledge-based  system.   Section  III  describes  the 
heuristic  searching  procedure  used  by  the  knowledge-based  scheduler  for 
constructing  schedules.   Section  IV  explores  a  decomposition  approach 
to  scheduling  with  reduced  complexity.   Section  V  shows  the  implementa- 
tion results  and  a  computation  study  on  the  impact  of  various  types  of 
heuristic  knowledge  on  the  performance  of  the  knowledge-based  scheduler, 

II.   Background 

II. 1.   The  FMS  Scheduling  Problem 

The  scheduling  of  jobs  in  an  FMS  has  been  addressed  by  a  number  of 
researchers  within  a  hierarchical  framework,  where  the  scheduling 
decision  consists  of  three  levels  (Buzacott  (1982),  Hitz  (1979),  Nof 
et  al.  (1979),  Stecke  (1983),  Gershwin  et  al .  (1985),  Buzacott  and  Yao 
(1986)): 

Level  1:   Prerelease  planning  -  Deciding  the  job  mix  to  be  manufactured 
and  the  constraints  on  operation  sequence. 

Level  2:   Job  entry  control  -  Determining  the  sequence  and  timing  of 
release  of  job. 

Level  3:   Operation  and  flow  control  -  Ensuring  the  best  routings  for 
the  jobs  based  on  the  availability  of  machines  and  other  resources. 
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This  paper  focuses  on  the  scheduling  aspect  at  the  operation  and 
flow  control  level  of  the  decision  hierarchy.   That  is,  if  the  production 
mix  of  jobs  is  specified  and  the  job  entry  sequence  is  known,  to  deter- 
mine the  machine  assignments  and  manufacturing  paths  for  the  jobs 
dispatched  into  the  system.   Such  a  scheduling  decision  can  be  made  by 
enumerating  the  manufacturing  paths  in  advance,  or  by  establishing  a 
set  of  decision  rules  which  determine  machine  assignment  in  real  time 
as  the  workpiece  makes  its  way  through  the  system  (Buzacott,  1982). 
In  the  FMS  environment,  where  the  machines  are  flexible  but  subject  to 
failures,  the  ability  to  schedule  jobs  in  real  time  and  to  reschedule 
jobs  dynamically  is  desirable.   Hitz  (1979)  used  a  periodic  scheduling 
algorithm  to  evaluate  schedules,  but  the  approach  required  that  the  job 
routings  be  determined  in  advance.   Kimemia  and  Gershwin  (1985)  devel- 
oped optimization  techniques  for  solving  the  flow  control  problem  by 
mathematical  programming.   Park  and  Shaw  (1986)  incorporated  sequencing 
heuristics  to  integrate  the  job  entry  and  flow  control  level  in  FMS 
scheduling.   Fox  (1983)  used  a  constraint-directed  approach  which  inte- 
grated the  scheduling  problems  on  the  three  levels.   Buzacott  and  Yao 
(1986)  provide  a  comprehensive  survey  on  the  analytical  techniques  that 
have  been  developed  and  used  in  all  three  levels  of  the  decision  hier- 
archy. 

The  inference  procedure  of  the  knowledge-based  scheduler  is  similar 
to  that  of  an  automatic  planning  system  in  the  AI  literature  (Fikes  and 
Nilsson  (1971),  Sacerdoti  (1977),  Vere  (1983),  Wilkins  (1984)).   Con- 
ceptually, an  automatic  planning  system  develops  a  course  of  action,  or 
a  "plan,"  for  the  agents  to  reach  the  goals  desired;  the  plan  will  then 
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be  used  to  guide  the  execution  of  planned  activities.   In  flexible  manu- 
facturing, the  agents — which  may  be  robots,  computerized  machine-centers, 
or  the  host  computer  of  a  manufacturing  cell — can  carry  out  a  variety 
of  operations,  including  various  types  of  machining,  workpiece  routing, 
loading,  and  unloading  operations. 

Furthermore,  the  knowledge-based  scheduler  we  developed  is  orga- 
nized as  a  hierarchical  system  consisting  of  three  levels:   strategic 
level,  planning  level,  and  operational  level  (Figure  II. 1).   Because  of 
the  scheduling  characteristics  of  the  flexible  manufacturing  cell,  the 
strategic  level  can  choose  four  different  planning  modes:   static  plan- 
ning, dynamic  planning,  plan-revision,  and  simulation.   The  inference 
engine  can  execute  either  forward-  or  backward-chaining  to  construct 
schedules.   By  this  design,  the  knowledge-based  scheduler  can  perform 
the  following  types  of  scheduling  functions: 

(1)  Adaptive  scheduling:  Schedules  are  generated  by  goal-driven  pro- 
cedures; the  scheduler  can  perform  dynamic  scheduling  to  adapt  to 
changes  in  the  FMS  environment. 

(2)  Planning:  State-space  inference  and  heuristic  search  are  used  to 
derive  production  processes. 

(3)  Optimizing:   Simulation  and  selection  of  plans  from  alternates  are 
done  by  evaluating  performance  criteria  and  heuristics. 

(4)  Learning:   Recognition,  refinement,  encoding,  and  integration  of 
processes  are  performed  to  enhance  the  scheduling  performance. 

This  paper  will  focus  on  the  first  three  aspects  of  knowledge-based 
scheduling. 


Insert  Figure  II. 1  Here 
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Figure  II. 1   The  Hierarchical  Structure  of  the 
Knowledge-Based  System 
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II. 2.   The  Organization  of  the  Scheduling  System 

A  general  knowledge-based  system  consists  of  three  components: 
a  database,  a  knowledge  base,  and  an  inference  engine.   The  database 
stores  declarative  knowledge  about  the  goals,  the  current  situation  of 
the  world,  and  the  semifinished  plan.   The  knowledge-base  stores  the 
domain-specific  and  procedural  knowledge,  often  represented  by  produc- 
tion rules  or  operators.   Finally,  the  inference  engine  stores  control 
knowledge  indicating  how  to  select  operators  and  when  to  apply  them. 

Because  scheduling  involves  exploration  of  alternative  sequences  of 
actions,  a  symbolic  model  of  the  real  world,  the  "world  model,"  repre- 
sents the  manufacturing  environment  in  the  scheduling  process.   For  any 
given  scheduling  problem,  the  initial  condition  and  the  stated  goal 
condition  are  both  treated  as  instances  in  the  world  model.   The  func- 
tion of  the  knowledge-based  scheduling  system,  then,  is  to  construct  a 
course  of  action  that  transforms  one  state  of  the  world  model,  which 
contains  an  initial  condition,  to  a  state  which  satisfies  the  goal  con- 
dition.  Thus  the  organization  of  the  knowledge-based  scheduling  system 
consists  of  the  following  three  components: 

(1)  The  database.   Sometimes  referred  to  as  the  blackboard,  the  data- 
base stores  the  world  model  and  partially  constructed  schedules. 
The  world  model  consists  of  symbolic  descriptions  of  the  real  world; 
this  world  model  is  represented  by  the  collection  of  first-order 
predicates  in  the  database  and  is  used  to  contain  state-descriptions 
of  the  FMS  environment  in  the  scheduling  process. 

(2)  The  knowledge  base.   The  principal  content  of  the  knowledge-base 
describes  the  transformational  effects  of  actions  that  map  states 
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to  other  states.   Such  transformations  are  usually  modeled  by 
operators  similar  to  the  STRIPS  operators  defined  in  Nilsson  [1980]. 
In  such  an  action  model,  each  operator  can  be  specified  as  follows: 


<  Action  -  name  > 

<  Precondition  > 

<  Add  list  > 

<  Delete  list  > 

<  Resource  > 


<  list-of -arguments  > 

<  list-of-precondition-literals  > 

<  list-of-add-list-literals  > 

<  list-of-delete-list-literals  > 

<  resource-name  > 


<  Duration  >        :  <  length-of-duration  > 
In  addition  to  the  standard  STRIPS  formalism — which  specifies  an 
action  by  the  add  list,  delete  list,  and  preconditions — we  have  also 
included  two  more  descriptions  for  each  action — the  "resource"  used 
during  the  action,  and  the  "duration"  of  the  action.   Some  sample 
operators  are  shown  in  the  Appendix.   The  knowledge-base  also  con- 
tains manufacturing  knowledge  in  the  forms  of  heuristics  and  con- 
straints . 
(3)  The  inference  engine,  which  directs  the  schedule-generation  process. 
It  selects  operators  to  achieve  the  goal  state  from  a  given  initial 
state.   The  inference  engine  employs  a  heuristic  searching  proce- 
dure which  will  be  discussed  in  more  details  in  Section  III. 


III.   Schedule  Generation  by  Heuristic  Searching 

The  scheduling  process  can  be  viewed  as  finding  the  solution  path 
in  a  search  tree,  such  as  the  one  shown  in  Figure  III.l,  carried  out  by 
either  forward-  or  backward-chaining.   In  forward-chaining,  the  root  of 
the  tree  is  the  initial  state,  and  instances  of  operators  define  the 
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branches.   Searching  for  solutions  is  accomplished  by  a  "generate-and- 
test"  process  (Newell  and  Simon,  1972):   at  a  given  node,  correspond- 
ing to  a  state  in  the  world  model,  new  nodes  are  generated  by  applying 
operators  (rules).   This  process  continues  until  the  goal  state  is 
generated.   The  backward  chaining  process  operates  in  reverse  direc- 
tion, i.e.,  starting  with  the  goal  and  reaching  for  the  initial  con- 
ditions.  The  key  issue,  then,  is  the  selection  of  the  most  appropriate 
operator  to  apply  at  a  given  state,  represented   as  a  node  in  the 
search  tree.   The  heuristic  knowledge  is  important  for  expediting  the 
searching  of  operators.   The  schedule-generation  process  can  be  achieved 
by  the  following  heuristic  search  procedure,  called  the  A  algorithm  in 
the  literature  (Nilsson,  1980;  Peal,  1983): 

Algorithm  3.1  (Operator-Search) 
Input : 

s0 

SG 
OP: 


the  initial  state 

the  goal  state 

the  set  of  operators 


Output : 

$:   a  linked  list  of  instantiated  operators. 

Begin 

1)  Place  So  on  a  list  called  OPEN;  create  a  list  called  CLOSED 
that  is  initially  empty. 

2)  LOOP:   If  OPEN  is  empty,  exit  with  failure. 

3)  Remove  from  OPEN  and  place  on  CLOSED  a  node  n  for  which  f(*)  is 
minimum. 

4)  If  n  matches  SG,  exit  successfully  with  the  plan  constructed  by 
tracing  the  solution  path  from  n  to  So*   Concatenate  the  operators 
in  the  order  of  their  application  to  form  the  plan  ty.    (Pointers 
are  established  in  Step  (5).) 


Initial  state 


Goal  State 


Figure  III.l   The  Search  Tree  for  Schedule  Generation 
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5)  Otherwise  expand  node  n,  applying  all  applicable  operators  in  OP 
to  generate  the  set  of  all  its  successors,  T;  attach  to  the  nodes 
in  T  pointers  back  to  n. 

For  every  successor  x  in  T,  Do 

Begin 

6)  If  x  is  not  already  on  OPEN  or  CLOSED,  estimate  h(x),  and  cal- 
culate 

f(x):  =  g(x)  +  h(x)  where 

g(x):  =  g(n)  +  c(n,x);  c(n,x)  is  the  cost  of  applying  the 
operator  corresponding  the  x. 

7)  If  x  is  already  an  OPEN  or  CLOSED,  direct  its  pointers  along  the 
path  yielding  the  lowest  g(n). 

End 

8)  Go  to  step  (2) 
End 

The  foregoing  procedure  essentially  transforms  the  planning  process 
into  a  graph  search  procedure  guided  by  a  heuristic  function.   The  pro- 
cedure keeps  two  lists  in  the  process  of  generating  the  search  tree:   an 
OPEN  list  contains  all  the  nodes  yet  to  be  expanded  (the  leave  nodes  of 
the  search  tree);  a  CLOSED  list  contains  all  the  nodes  already  expanded 
(the  nonleave  nodes).   For  the  A*  algorithm,  the  heuristic  function  f(*) 
consists  of  two  components:   f(n)  =  g(n)  +  h(n),  where  g(n)  -   the  cost 
of  the  path  found  by  A*  from  Sn  to  n;  and  h(n)  =  the  estimated  cost  of 
a  path  from  n  to  S~. 


Insert  Figure  III.l  Here 


The  A*  algorithm  is  a  best-first  searching  procedure  which  uses 
the  heuristic  function  f (  •)  to  guide  the  search  of  the  optimal  path. 
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Studies  (Nilsson,  1980;  Peal,  1983)  have  shown  that  when  A*  employs  a 
perfectly  informed  heuristics  (h=h*)  it  is  propelled  directly  toward 
the  goal  without  ever  getting  sidetracked,  spending  only  M  computa- 
tional steps  where  M  is  the  number  of  state-transitions  to  the  goal 
node.   At  the  other  extreme,  when  no  heuristic  knowledge  is  available 
(c(n,x)=l,  h  =  0;  where  c(n,x)  represents  the  cost  of  applying  an 
operator  expanding  n  to  x) ,  the  search  becomes  breadth-first,  yielding 
an  exponentially  growing  complexity. 

In  generating  schedules  based  on  the  state-space  inference  approach, 
the  optimal  path  consists  of  a  sequence  of  operators  that  yield  the  best 
schedule.   The  selection  of  these  operators  can  be  accomplished  by 
algorithm  3.1,  where  the  A*  heuristic  is  used  to  guide  the  search.   In 
general,  an  A*  algorithm,  such  as  Algorithm  3.1,  guides  the  search  of 
optimal  path  by  excluding  unnecessary  node  expansions. 

Let  C    be  the  cheapest  cost  of  paths  going  from  S  to  S  ,  i.e., 
0 ,  G  0      G 

C    =  h*(S  ).   If  the  cheapest  cost  of  all  solution  paths  constrained 
0  ,G       0 

to  go  through  n  is  denoted  by  f*(n),  then 

(3.1)  f*(n)  =  g*(n)  +  h*(n),  for  any  n,  and 

*  * 

(3.2)  f*(n)  =  C.   for  n  e  Pc   _ 

0,G  SQ,SG 

*  * 

(3.3)  f*(n)  >  Cn  _  for  n  £   Pc 

0,G  SQ,SG 

where  PQ   0   stands  for  the  set  of  optimal  path  from  S   to  S  .   Then 

VbG  °      G 

conditions  (3.2)  and  (3.3)  imply  that  following  the  minimum  f*  would 

constitute  a  perfect  search  strategy  for  schedule  generation,  leading 

straight  toward  an  optimal  solution  without  ever  getting  sidetracked. 
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However,  usually  information  on  f*(n)  is  not  possessed,  especially  the 

h*(n)  component.   The  A*  heuristic  is  aimed  at  estimating  C    and  pro- 

U ,  G 

viding  a  measurement  on  how  promising  a  node  is  to  be  on  the  optimal 
path.   The  performance  of  the  A*  algorithm  is  dictated  by  the  following 
two  lemmas : 


Lemma  3.1:   If  there  exists  a  path  from  the  initial  state  S~  to  the 

goal  state  S  ,  the  A*  algorithm  must  terminate  in  finite  steps. 
G 

Lemma  3.2:  \Then    the  A*  algorithm  uses  a  heuristic  function  that  con- 
tains an  h( . )  component  such  that 


(3.4)    0  <  h(n)  <  h*(n),  for  every  node  n, 


then  the  A*  algorithm  only  terminates  by  finding  optimal  path  to  the 
goal  state. 


Lemma  3.1  indicates  that  the  A*  algorithm  is  complete ,  Lemma  3.2  indi- 
cates that  the  A*  algorithm  is  admissible .   (A  search  algorithm  that  is 
guaranteed  to  find  an  optimal  path  to  a  goal,  if  one  exists,  is  called 
admissible  (Nilsson,  1980)).   In  Section  V,  we  shall  relate  the  A* 
heuristic  to  various  scheduling  heuristics  and  compare  their  performance 

I I I . 2   An  Application  Example 

This  section  presents  an  example  applying  the  aforementioned  AI 
scheduling  method  to  the  FMS  environment.   The  FMS  to  be  scheduled  in 
this  example  integrates  the  operations  for  flexible  machining  and 
assembly. 

Suppose  the  jobs  to  be  done  in  the  system  are  as  shown  in  Table 
III. 1(a),  where  jobs  1  and  2  are  machining  and  job  3  is  an  assembly  job. 
The  final  part  is  a  cylindrical,  as  shown  in  Figure  III.l.   The  machine 


ptl 


pt2 


pt3 


Figure  III. 2   The  Parts  Used  in  the  Example 
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(b)  Operation  Specifications 


Machine 

Operation 

M2 
M3 

0P2       0P5 
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(c)  Machine  Capabilities 


Table  III.l   Specifications  for  the  Example  Problem 
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capabilities  of  the  machine  are  shown  in  Table  III. 1(c).   A  sample  set 
of  operators  for  this  example  is  shown  in  the  Appendix. 

The  Operator-Search  Algorithm  is  executed  to  generate  a  schedule 
for  integrating  the  machining  and  assembly  operations.   The  final  sche- 
dule, a  partially  ordered  network  of  operators  with  instantiated  opera- 
tors, is  shown  in  Figure  III. 3. 

Insert  Figure  III. 2,  Table  III.l,  Figure  III. 3  Here 

IV.   Nonlinear  Planning:   A  Decomposition  Approach 

If  the  FMS  scheduling  problem  is  solved  by  the  Operator-Search 
Algorithm  directly,  the  complexity  of  the  searching  procedure  can  grow 
prohibitively  large  (a  simpler  problem,  the  job-shop  scheduling  problem, 
has  been  shown  to  be  NP-coraplete  (French,  1982;  Gonzalez  and  Sahni , 
1978;  Lenstra  and  Rinnooy  Kan,  1978)).   In  general,  the  computation 
complexity  of  a  searching  procedure  is  determined  by  the  number  of 
nodes  generated,  i.e.,  by  the  size  of  the  search  tree.   For  schedule 
generation,  the  size  of  the  search  tree  is  bounded  by  b  ,  where  b  is 
the  branching  factor  and  d  is  the  depth  of  the  tree.   For  a  N-job-M- 
machine  scheduling  problem  solved  by  the  state-space  searching  pro- 
cedure, b  is  affected  by  the  average  number  of  applicable  operators  at 
any  node  expansion;  d  is  proportional  to  the  average  number  of 

operation  of  each  iob,  N   ,  i.e.,  d  =  E  •  N   where  f  is  a  constant. 

J     op  op 

For  multijob  scheduling,  both  b  and  d  are  also  proportional  to  the 
number  of  jobs  N  .   The  size  of  search  tree  of  Algorithm  3.1  in  the 
worse  case  would  be 
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(b  x  N  )*    °P    J 


This  can  grow  into  a  huge  tree  even  for  very  small-sized  problems. 

To  overcome  this  complexity  difficulty,  we  employ  a  decomposition 
approach.   Specifically,  a  nonlinear  planning  algorithm  is  used  in  the 
knowledge-based  scheduler.   It  decomposes  an  n-job-m-machine  problem 
into  n  subproblems,  with  each  subproblera  defined  as  the  routing  of  one 
job.   Each  subproblera  is  then  similar  to  a  single-agent  planning  problem, 
Algorithm  3.1  is  applied  to  generate  a  "plan"  for  the  n  subproblems; 
the  primary  interactions  between  these  subproblems  are  their  sharing  of 
the  machines.   The  objective  of  the  scheduling  problem — to  minimize 
makespan  while  avoiding  conflicting  assignments — can  be  translated  into 
the  criterion  for  the  plan-generation  problem:   to  maximize  the  paral- 
lelism while  avoiding  harmful  interactions  among  the  subplans  (Sacerdoti 
(1977),  Pednault  (1985)).   This  procedure  is  shown  as  follows. 

Algorithm  4.1  (Nonlinear  Planning) 
Begin 

(1)  Generate  a  plan  for  each  job  by  Algorithm  3.1. 

(2)  Identify  conflicting  interactions  between  the  planned  opera- 
tors and  established  precedence  constraints  to  avoid  sched- 
uling conflicts. 

(3)  Use  a  Plan-Revision  Procedure  to  improve  the  makespan  as  much 
as  possible. 

End 

The  Step  2  of  this  procedure  dynamically  decides  the  precedence 
relationship  between  two  conflicting  operators.   The  underlying 
principle — based  on  the  least  commitment  strategy — is  not  to  impose 
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any  precedence  constraint  unless  it  is  absolutely  necessary,  so  that 
the  parallelism  among  the  subplans  is  maximized.   Information  about 
resources  and  duration  of  operators  is  crucial  to  the  inference  engine 
in  making  these  decisions. 

When  a  precedence  constraint  is  established,  the  operator 
restricted  by  the  constraint  is  put  on  a  list  called  Alternate-list. 
In  Step  3,  the  plan-revision  step,  the  scheduling  system  examines  each 
operator  on  Che  Alternate-list  and  attempts  to  find  if  any  alternative 
resource  can  reduce  the  queueing  time.   If  such  a  resource  exists,  a 
forward-chaining  procedure  is  used  to  modify  the  related  section  of 
the  plan.   This  revision  procedure  is  executed  for  every  operator  on 
the  Alternate-list,  but  the  forward-chaining  procedure  is  executed 
only  if  reassigning  the  resource  can  improve  the  makespan.   The  Plan- 
Revision  procedure  is  described  as  follows. 

The  Plan-Revision  Procedure 

(1)  Select  the  first  operator  on  the  Alternate-list;  identify  the 
resource  for  which  this  operator  is  assigned. 

(2)  Locate  the  corresponding  critical  section  of  the  subplan. 

(3)  Compare  the  expected  waiting  time  with  the  additional  pro- 
cessing time  by  an  alternative,  idle  resource.   If  no  im- 
provement is  possible,  exit.   Otherwise,  go  to  Step  4. 

(4)  Find  out  the  initial  conditions  and  the  ending  conditions  of 
this  critical  section. 

(5)  Generate  a  forward-chaining  plan  that  can  transform  the  ini- 
tial conditions  to  the  goal  conditions,  using  another  idle 
resource . 

(6)  Modify  the  subplan  by  replacing  the  section  identified  in 
Step  2  with  the  newly  generated  plan  from  Step  5. 
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Based  on  the  performance  properties  of  A*  heuristic  search,  we  can 
derive  the  following  theorem: 

Theorem  3.1.   The  nonlinear  planning  algorithm  is  both  complete  and 
correct  (for  proof  see  Shaw  [1986]). 

Theorem  3.1  provides  two  performance  guarantees  on  applying 
Algorithm  4.1  to  the  multijob  FMS  scheduling  problem:   It  can  reach 
the  solution  in  finite  steps  (completeness)  and  when  it  finishes,  it 
always  finds  the  solution  if  such  a  solution  exists  (correctness). 
However,  Algorithm  4.1  is  not  admissible  because  of  the  decomposition — 
it  only  achieves  suboptimal  schedules.   The  Plan-Revision  Procedure  is 
to  improve  the  suboptimal  schedule  as  much  as  possible  by  identifying 
alternative  resources  for  the  planned  activities. 

IV. 2  An  Example 

In  this  section  we  shall  use  an  example  to  illustrate  major  features 
of  the  scheduling  approach.   This  example  concerns  a  3-machine  cell 
consisting  of  one  CNC  lathe  and  two  CNC  milling  machines;  a  linear 
table  and  two  robots  are  used  for  material  handling,  loading/unloading, 
and  transporting  workpieces  between  machines.   There  is  a  cell-host 
supervisory  computer  in  charge  of  the  scheduling  and  control  of  the 
cell.   The  operation  capability  (i.e.,  loading)  of  each  machine  is 
shown  in  Figure  IV. 1(a). 

Suppose  there  are  three  jobs  needed  to  be  scheduled,  denoted  by 
PT12,  PT6,  PT16,  each  job  requiring  a  different  set  of  operations  shown 
in  Figure  IV. 1(b). 
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Based  on  algorithm  4.1,  the  first  step  is  to  generate  a  schedule 
for  each  job,  resulting  in  the  three  schedules  shown  in  Figure  IV. 2(a). 
Each  schedule,  produced  by  the  planning  procedure  of  Algorithm  3.1, 
consists  of  a  sequence  of  instantiated  operators  (only  the  operator 
name  and  the  corresponding  resource  are  shown  in  the  figure).   The 
second  step  of  the  algorithm  is  to  synthesize  the  linear  schedules  into 
a  single  schedule  by  using  precedence  constraints  to  resolve  conflicts. 
The  final  step  is  to  improve  the  synthesized  schedule  as  much  as  pos- 
sible by  checking  each  delayed  activity  and  by  employing  alternative 
resources.   An  instance  of  plan  revision  occurs  at  activities  Q3  and  Q4 
of  PT6 ,  which  moves  from  M3  to  M2.   The  final  schedule,  a  partially 
ordered  network,  is  shown  in  Figure  IV. 2(b). 


Insert  Figures  IV. 1  and  IV. 2  Here 


IV. 3   Dynamic  Scheduling 

In  flexible  manufacturing  systems,  jobs  arrive  at  a  manufacturing 
cell  dynamically,  each  requiring  a  variety  of  operations.   When  new 
jobs  need  to  be  scheduled  during  the  execution  of  existing  jobs,  a 
dynamic  version  of  the  nonlinear  planning  algorithm,  such  as  the 
following  one,  can  be  invoked  to  accommodate  the  new  jobs. 
Step  1.   Establish  schedules  for  the  new  jobs  based  on  the  current 

machines  availability  shown  in  the  world  model; 
Step  2.   Use  the  conflict-resolution  scheme  to  coordinate  the  planned 

operators  for  the  new  jobs  and  the  remaining  operators  for 

the  old  jobs; 
Step  3.   Improve  the  modified  schedule  by  the  same  plan-revision  scheme 


-17- 

The  underlying  logic  of  this  scheme  follows  directly  from  the 
aforementioned  nonlinear  planning  algorithm.   After  a  tentative  schedule 
is  established  for  the  new  jobs  in  Step  1,  the  forward-chaining  proce- 
dure is  applied  to  generate  a  precedence  network  coordinating  the 
planned  operators  for  the  remaining  operations  of  the  old  jobs  and  the 
operators  needed  by  the  new  jobs.   The  dynamic  scheduling  scheme  is 
performed  on  (1)  the  unfinished  schedule  for  existing  jobs  and  (2) 
linear  schedules  for  the  new  jobs.   The  same  Plan-Revision  procedure  is 
then  used  for  achieving  minimum  makespan.   An  example  of  the  use  of  the 
dynamic  scheduling  algorithm  is  shown  in  Figure  IV. 3. 


Insert  Figure  IV. 3  Here 

V.   Implementation  and  Computational  Performance 

The  knowledge-based  system  for  FMS  scheduling  is  written  in  Common 
LISP  and  has  been  implemented  on  Explorer,  a  LISP  machine  manufactured 
by  Texas  Instruments  for  symbolic  processing.   The  embedded  inference 
engine  was  a  goal-directed,  backward-chaining  procedure  to  generate 
plans  and  a  forward-chaining  procedure  for  plan-revision.   To  evaluate 
the  performance  of  the  scheduler,  we  randomly  generated  ten  jobs  for 
testing  in  a  3-machine  cell,  where  two  versions  of  the  non-linear 
planning  algorithm  were  tested:   one  with  breadth-first  search  (h(n)  = 
0);  one  with  A*  search  (h(n)  =  estimated  remaining  processing  time). 
The  computation  results  are  shown  in  Figure  V.l.   Two  interesting 
observations  are  worth  noting.   First,  the  use  of  A*  heuristic  in  sche- 
duling significantly  reduces  the  size  of  the  search  tree,  thus  improv- 
ing the  scheduling  performance.   Second,  the  numbers  of  iterations  for 
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Figure  IV. 1   (a)  Operation  Loading  and  Processing 
Times,  (b)  Job  Specifications 
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Figure  IV. 3   An  Example  of  Dynamic  Scheduling  When  a 
New  Job  Enters  the  System 
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conf lict-resolution  and  plan-revision  grow  faster  than  the  number  of 
nodes  (states)  generated.  This  reflects  the  decomposition  nature  of 
the  algorithm. 


Insert  Figure  V.l  Here 

In  order  to  compare  the  impact  of  heuristic  knowledge  on  scheduling 
performance,  we  also  conducted  a  computation  experiment  to  test  the 
scheduling  conplexity  associated  with  four  different  heuristics  defined 
as  follows: 

fn(n)  =  g(n)  =  height  of  the  search  tree 

f  (n)  =  g  (n)  +  h  (n)  =  (cumulative  processing  time)  + 
(estimated  total  remaining  processing  time) 

f  (n)  =  g  (n)  +  h  (n)  =  (cumulative  processing  time)  + 
(imminent  operation  time) 

f„(n)  =  g  (n)  +  h  (n)  =  (cumulative  processing  time)  + 
(number  of  operations  left) 

The  computation  study  was  conducted  on  a  three-machine  FMS  cell  for 
which  we  randomly  generated  a  set  of  ten  jobs,  each  job  requiring  three 
randomly  generated  operations.   The  operation  loading  (i.e.,  the  set  of 
operations  assigned  to  the  machines)  is  also  randomly  generated  from  a 
pool  of  12  operations. 

The  computation  results  corresponding  to  the  four  heuristics  are 
shown  in  Figure  V.2,  where  the  size  of  the  search  tree  is  used  to  indi- 
cate computation  complexity.   Among  the  four,  f , (  •)  results  in  the  best 
performance,  whereas  f~(*)  is  consistently  second-best.   This  can  be 
explained  by  the  fact  that,  while  both  f,(0  and  f„(  •)  are  admissible 
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Figure   V.l      Performance   Results   of    the   Knowledge-Based    Schedules 
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(since  h.(n)  _<  h  *(n)  and  h  (n)  _<  h  *(n)),  f  (  •)  utilizes  more  global 
information  (Ow  (1984))  than  f~(0  does.   f  (  •)  does  not  perform  as 
well  as  f |  ( •)  or  f^CO  because  it  does  not  use  processing  time  infor- 
mation, resulting  in  a  general  but  weaker  heuristic.   However,  h„(  •) 
still  accounts  for  some  scheduling  knowledge  by  estimating  the  number 
of  remaining  operations,  contributing  to  the  better  performance  of 
f~(0  than  f  (•)•   Accordingly,  the  computation  experiment  indicates 
that  (1)  a  good  heuristic  knowledge  is  important  in  improving  the  sche- 
duling performance,  (2)  a  global  heuristic  is  better  than  a  local 
heuristic  and  (3)  a  domain-specific  heuristic  is  better  than  a  general 
heuristic. 


Insert  Figures  V.2  and  V.3  Here 


The  performance  of  the  scheduling  system,  as  measured  by  the  size 
of  the  search  tree,  is  also  affected  by  the  number  of  alternatives  that 
have  to  be  enumerated  in  selecting  the  solution  path.   There  are  two 
sources  for  alternative  decisions:   the  number  of  alternative  machines 
for  an  operation  and  the  number  of  applicable  activities,  as  modeled 
by  operators.   The  former,  termed  "contention  factor,"  reflects  the 
flexibility  of  the  FMS ;  the  latter,  referred  to  as  the  "branching  fac- 
tor," indicates  the  dependency  between  operators.   For  example,  Figure 
V.3  contrasts  the  effect  of  heuristic  f   in  systems  with  different 
levels  of  contention  factors.   When  the  contention  factor  decreases, 
the  size  of  the  search  tree  would  decrease.   Furthermore,  the  improve- 
ment of  performance  by  using  good  heuristic  becomes  more  significant, 
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as  shown  in  Figures  V.3(a)  and  (b).   Thus,  using  a  good  heuristic  be- 
comes even  more  important  in  the  FMS  when  the  degree  of  flexibility 
increases  and  machines  are  set  up  for  a  wide  variety  of  operations. 

VI.   Conclusion 

This  paper  describes  a  knowledge-based  scheduler  for  FMSs.   Organized 
as  a  hierarchical  system,  the  scheduler  can  perform  scheduling/ 
rescheduling  in  order  to  handle  the  dynamically  changing  FMS  environment. 
By  using  a  symbolic  world  model  and  the  automatic  planning  technique  for 
generating  schedules,  the  knowledge-based  scheduler  can  schedule  jobs  in 
an  FMS  in  real  time  and  assign  resources  dynamically;  these  features  are 
important  for  FMS  scheduling  because  of  the  shorter  lead-times  and  ver- 
satile machines.   We  have  also  shown  the  importance  of  heuristic  knowl- 
edge in  expediting  the  scheduling  process.   A  decomposition  algorithm, 
similar  to  nonlinear  planning,  is  employed  for  schedule-generation  with 
reduced  complexity. 
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Appendix   Sample  Operators  in  the  Knowledge  Base 


TRAHSFE2  (?m  ?mp  Top  ?opp  ?pt) 

Precondition:  finish-op  (?m  ?op  ?pt)  &  pt-nextop  (Top  Topp  Tpt) 

&  mach-op  (Tmp  Topp)  &  different  (Tm  Tmp) 
Add-list         mach-pt  (Tmp  Topp  Tpt)  &  idle  (Tm) 
Delete-list      finish-op  (Tm  Top  Tpt)  &  pt-nextop  (Top  Topp  Tpt) 
Resource:        Tmp 
Duration:        2 

HUTOP  (Tm  Top  Topp  Tpt) 

Precondition:  finish-op  (Tm  Top  Tpt)  &  pt-nextop  (Top  Topp  Tpt) 

&  mach-op  (Tm  Topp) 
Add-list         mach-pt  (Tm  Topp  Tpt) 

Delete-list:      finish-op  (Tm  Top  Tpt)  &  pt-nextop  (Top  Topp  Tpt) 
Resource:        Tm 
Duration:         0 

UHLOAD  (Tm  dock  Top  Tpt) 

Precondition:  finish-op  (Tm  Top  Tpt)  &  pt-nextop  (Top  nil  Tpt) 

Add-list:         mach-pt  (dock  un-load  Tpt)  &  idle  (Tm) 

Delete-list:      finish-op  (Tm  Top  Tpt)  &  pt-nextop  (Top  nil  Tpt) 

Resource:        dock 

Duration:         3 

EXIT  (Tpt) 

Precondition:  mach-pt  (dock  un-load  Tpt)  &  idle  (dock) 

Add-list  done  (Tpt)  &  in-buffer  (Tpt) 

Delete-list  mach-pt  (dock  un-load  Tpt) 

Resource:  dock 

Duration:  1 


Appendix  (continued) 


SETUP  (Tsubpt  ?pt  arm) 

Precondition:  first-subpt  (Tsubpt  ?pt)  &  prepared  (?subpt  ?pt) 
Add-list         finish-subpt  (Tsubpt  Tpt)  &  idle  (arm) 
Delete-list:      first-subpt  (Tsubpt  Tpt)  &  prepared  (Tsubpt  Tpt) 

&  in-arm  (Tsubpt  Tpt) 
Resource:        arm 
Duration:         1 


MOVE-ARM  (arm  Tp  Tsubpt  Tpt  buffer) 
Precondition:  idle  (arm)  &  position  (arm  Tp) 

&  ready -to-assemble  (Tsubpt  Tpt) 
Add-list         position  (arm  buffer)  &  ready-to-grasp  (Tsubpt  Tpt) 
Delete-list      idle  (arm)  &  position  (arm  Tp) 

&  ready -to-assemble  (Tsubpt  Tpt) 
Resource:        arm 
Duration:         2 


GRASP  (Tsubpt  arm  buffer  Tpt) 

Precondition:  position  (arm  buffer)  &  ready-to-grasp  (Tsubpt  Tpt) 

Add-list         in-arm  (Tsubpt  Tpt) 

Delete-list:      in-buffer  (Tsubpt)  &  ready-to-grasp  (Tsubpt  Tpt) 

Resource:        arm 

Duration:         1 


EXECUTE  (Tm  Top  Tpt) 

Precondition:  mach-pt  (Tm  Top  Tpt)  &  idle  (Tm)  &  mach-op  (Tm  Top) 

Add-list         finish-op  (Tm  Top  Tpt) 

Delete-list      mach-pt  (Tm  Top  Tpt)  &  idle  (Tm) 

Resource:        Tm 

Duration:        (lookup  (Tm  Top)) 
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